File: 3023.VSD 




Docket No. AUS920030414US1 A PP L No - 10/671,057 

Accapadi et al. Filln 9 Date 09/25/2003 

System and Method for CPI Load Balancing in SMT Environments Art Unit 2122 

1/12 



Scheduler 
100 



Executable Threads 
110 



Thread Data 



Thread Data 



Thread Data 



Thread Data 



Thread Data 



Processor Thread 
130 




Processor 
Resource 
150 



Processor 
Resource 
160 



Processor 
Resource 
170 



Multi-Threaded (SMT) Processor 
120 



Figure 1 



File- 3023 VSD Docket No. AUS920030414US1 A PP L No - 10/671,057 

Accapadi et al. Filin 9 Date 09/25/2003 

System and Method for CPI Load Balancing in SMT Environments Art Unit 2122 



2/12 



ThrPflH 

1 I lICCIU 

ID 
215 


1 st Pomnatihlo 

Thread ID 

220 


1st f^nmnatihlo 
l oui I ijJcUiuiu 

Thread CPI 

225 


ond pnmnotihlo 

C OUll lpdLIUIc 

Thread ID 


Thread CPI 

9^5 
coo 


o oornpaiiDic 
Thread ID 

940 


Qpfj Pn mr\ of iKIq 

o uornpaiiDie 
Thread CPI 

OAR 
CHo 


aaa 


bbb 


0.7 


ddd 


1.0 


fff 


1.2 


bbb 


aaa 


0.7 


ccc 


1.3 


[null] 


[null] 


ccc 


bbb 


1.3 


ddd 


0.8 


fff 


1.5 


ddd 


aaa 


1.0 


ccc 


0.8 


ggg 


0.9 


eee 


ddd 


1.4 


[null] 


[null] 


[null] 


[null] 


fff 


aaa 


1.2 


ccc 


1.5 


[null] 


[null] 


ggg 


ddd 


0.9 


[null] 


[null] 


[null] 


[null] 


hhh 


[null] 


[null] 


[null] 


[null] 


[null] 


[null] 



Thread Control Block 

210 



Thread 
ID 

275 


Ready to 
Execute 
280 


aaa 


Y/N 


ccc 


Y/N 


eee 


Y/N 


ggg 


Y/N 


Run Queue A 

270 













CPI 






Threshold 






2£5 



Scheduler 

200 











Processor 




Processor 






Thread A 




Thread B 






255 




260 




SMT Processor 




250 





Thread 
ID 

290 


Ready to 
Execute 
295 


bbb 


Y/N 


ddd 


Y/N 


fff 


Y/N 


hhh 


Y/N 


Run Queue B 

285 



Figure 2 



File: 3023. VSD 



Docket No. AUS920030414US1 A PP<- No - 10/671,057 

Accapadi et al. Filin 9 Date 09/25/2003 

System and Method for CPI Load Balancing in SMT Environments Art Unit 2122 



3/12 



Start 
300 



I 



Receive Notice - Currently Running 
Thread About to Task Out 
305 



318 



rMaueue "A" - 



Completing 
^Thread on Which Queue?" 
310 



-Queue "B" 



Check List of Threads Compatible 
with Thread Running on Processor 
Thread B in Order of Compatibility 
320 





352 



Thread 
Control Block 
315 



Check List of Threads Compatible 
with Thread Running on Processor 
Thread A in Order of Compatibility 

355 





Check Next Most 


1 — ► 


Compatible 




330 




"Ready to Run?^ 




"\ 335 

3 




346 k 




No^~ 342 



Run 
Queue 

"A" 
330 



Run 
Queue 

"B" 
370 




Check Next Most 
Compatible 
365 




Yes 



Dispatch 
Thread 
340 



Dispatch Next 
Available Thread 
350 



Dispatch 
Thread 
380 



. 1 



• 




End 
325 



Dispatch Next 
Available Thread 
220 



Figure 3 



File: 3023. VSD 



Docket No. AUS92003041 4US1 A PP L No - 1 0/ 671 ,057 

Accapadi et al. Filin 9 Date 09/25/2003 

System and Method for CPI Load Balancing in SMT Environments Art Unit 2122 



4/12 



/update Compatibility Lists 
I 400 

I 



Retrieve Thread IDs for Thread That 
Just Completed (Last) and Thread 
That is Still Executing on Other 
Processor Thread (Current) 
405 



I 



Calculate CPI Achieved During Time 
that Last Thread and Current Thread 
Were Both Executing 
410 




Remove Entries 
(See Figure 5) 
420 




Check Last Thread's 
Compatible Thread List, 
Update Data if Already Listed 
430 



442 



-No- 




Record Current Thread ID, CPI and 
Timestamp in One of the Open Slots 
440 




Overwrite Highest Existing Compatible 
Thread Data with Current Thread ID, CPI, 
and Timestamp 
450 



Check Current Thread's 
Compatible Thread List, Update 
Data if Last Thread Already Listed 
460 




Record Last Thread ID, 
CPI, and Timestamp in One 
of the Open Slots 
475 




Overwrite Highest Existing 
Compatible Thread Data 
with Last Thread ID, CPI, 
and Timestamp 
490 



End 
495 



Figure 4 



Docket No. AUS920030414US1 A PP>- N °- 10/671,057 

Accapadi et al. Filin 9 Da * e 09/25/2003 

System and Method for CPI Load Balancing in SMT Environments Art Unit 2122 

5/12 



Remove Entries As Needed 
500 



Check Last Thread's 
Compatible Thread List 
5J0_ 




Remove Current Thread From 
Last Thread's Compatible 
Thread List 
530 



Check Current Thread's 
Compatible Thread List 
550 



Thread 
Control Block 
540 




Remove Last Thread From 
Current Thread's Compatible 
Thread List 
580 



End 
595 



Figure 5 



File: 3023.VSD 



Docket No. AUS920030414US1 A PP L No - 10/671,057 

Accapadi et al. Filin 9 Date 09/25/2003 

System and Method for CPI Load Balancing in SMT Environments Art Unlt 2122 



Clean Up Thread Compatibility List 
600 



6/12 



Wake Up at Time Interval 
(i.e., every 2 seconds) 
605 




Read Next Thread in 
Thread Control Block 
690 



Figure 6 



File: 3023.VSD Docket No. AUS920030414US1 B { PP '« N f ' HSIiSI 

Accapadi et al. Fllm 9 Date 09/25/2003 

System and Method for CPI Load Balancing in SMT Environments Art Unit 2122 



7/12 



Thread ID 
Z15 


Thread's Last 
CPI Value 
720 


Thread's Last 
CPI Value - 1 
Z25 


Thread's Last 

/"\ |—>s 1 V / 1 f\ 

CPI Value - 2 
730 


Thread's Last 
CPI Value - n 
735 


Thread's 
Average CPI 
740 


aaa 


0.7 


0.3 


0.4 


0.6 


0.5 


bbb 


0.5 


0.7 


0.8 


0.4 


0.6 


ccc 


1.0 


0.6 


0.9 


0.7 


0.8 


ddd 


1.1 


0.8 


1.2 


0.9 


1.0 


eee 


1.4 


1.3 


1.6 


1.7 


1.5 


fff 


2.4 


2.5 


2.7 


2.8 


2.6 


ggg 


1.8 


2.4 


1.9 


2.3 


2.1 


hhh 


2.7 


2.8 


2.8 


2.9 


2.8 


Thread Control Block 

Z10 



Thread IDs 
Z50 


► 


Scheduler 

zoo 




Thread IDs 
775 




"+ ► 


aaa 






bbb 


ccc 






f 




ddd 


eee 




Swap Worst 
Performing Threads 
ZQ5 




fff 


ggg 






hhh 


SMT Processor 1 
Run Queues 

755 






SMT Processor 2 
Run Queues 

780 



Processor 




Processor 


Thread A 




Thread B 


ZS5 




Z70 



SMT Processor 1 

Z60 



Figure 7 



Processor 




Processor 


Thread A 




Thread B 


790 




795 



SMT Processor 2 

785 



File- 3023 VSD Docket No. AUS920030414US1 A PP L No - 10/671,057 

Pile. 3023. voD Accapadi et al. Filin 9 Date 09/25/2003 

System and Method for CPI Load Balancing in SMT Environments Art Unit 2122 

8/12 



Update Thread CPI 
800 



1 


r 


Dispatch Thread 
810 




f 


Check Initial CPI 
820 


1 


r 



Thread Executes 
830 



Receive Notice - Currently Running 
Thread About to Task Out 
840 



Check Final CPI 
850 



Store CPI for Thread's 
Latest Run Cycle 
860 



Calculate Thread's Average CPI 
(Sum of CPIs During Run Cycles) 
880 



Thread Table 
870 



Store Thread's Average CPI 
890 




Figure 8 



File- 3023 VSD Docket No. AUS920030414US1 A PP L No - 10/671,057 

Accapadi et at. Filin 9 Date 09/25/2003 

System and Method for CPI Load Balancing in SMT Environments Art Unit 21 22 



9/12 




Figure 9 



File: 3023. VSD 



Docket No. AUS920030414US1 A PP'- No - 10/671,057 

Accapadi et al. Filin 9 09/25/2003 

System and Method for CPI Load Balancing in SMT Environments Art ^ nit 2122 



10/12 



Identify Poor Performing Thread 
1000 



Thread Completes (Preempted) 
1005 



I 



Check Completed Thread's CPI 
1010 




Thread Table 
1015 



1022 



-No- 



End 
1025 



Check Previously Swapped 
Data Structure 
1030 



Previously 
Swapped Threads 

Thread ID, 
CPI at Time of Swap, 
Timestamp of Swap 
104Q 



Identify Next Worst 
Performing Thread on 
Selected Processor 
1070 




Figure 10 



File: 3023. VSD 



Docket No. AUS920030414US1 A PP'- No - 10/671,057 

Accapadi et al. Filin 9 Date 09/25/2003 

System and Method for CPI Load Balancing in SMT Environments Art Unit 2122 



11/12 



Swap List 
1120 



Swap Poor Performing Threads^, 

WSl J 



Retrieve Two Threads 
(Threadl & Thread2) from 
Swap List 
1110 



I 



Place Threadl on Run 
Queue Corresponding to 
Thread2 
1125 



Place Thread2 on Run 
Queue Corresponding to 
Threadl 
1130 



Update Thread Table 
1140 



Thread 
Table 
U5Q 



Write Data for Threadl & 
Thread2 into Previously 
Swapped List 
1160 



Remove Threadl and 
Thread2 from Swap List 
1175 



Previously 
Swapped Threads 

Thread ID, 
CPI at Time of Swap, 
Timestamp of Swap 
1170 




Figure 11 



File: 3023.VSD 



Docket No. AUS920030414US1 A PP>- N °- 10/671,057 

Accapadi et al. Fmn 9 Date 09/25/2003 

System and Method for CPI Load Balancing in SMT Environments Art Unlt 2122 



12/12 



1222 



JTAG/I2C Busses , 



JTAG/I2C Busses 



c 



Host Bus 

3Z= 




1201 



1202 



Level Two Cache 
1204 



JTAG/I2C 



c 



Main Memory 
1208 



JTAG/I2C 



PCI Bus 



I 



Service Processor 
Interface & ISA Access 
Passthru 
1212 




LAN Card 
1230 




1270- 



1268- 



Figure 12 



